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SYSTEM AND METHOD FOR ADAPTIVE FORMATTING OF IMAGE 
INFORMATION FOR EFFICIENT DELIVERY AND PRESENTATION 

Background of the Invention 

1 . Field of the Invention 

This invention generally relates to the field of network image transfer, and 
more particularly relates to the transfer of optimized image information relative to a 
network communication capability and a requesting device presentation capability. 

2. Description of Related Art 

Image information communication is commonly handled through a 
heterogeneous network. Additionally, image serving via the Internet is regularly 
designed for reception by both wired and wireless networked devices. 
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In the case of wired devices the connection nnay be through a high 
bandwidth T-1 connection, DSL, Cable modem, or using a telephone connected 
modem. The connection speed ranges from megabits per second down to 14 
Kbits per second or even lower. 

5 

The wireless devices may be a fully functional desktop workstation 
connected through a very high bandwidth satellite connection or at the other 
extreme a small cell phone with a very slow connection to the Internet, 

10 Cutting across the connection speed is the connected devices processing 

power and display capability. The display can range from a very large engineering 
workstation down to a cell phone with only an alphanumeric display. 

Client/Server topology allows for web servers to respond to a user's request 
15 for certain files. Given a GUI (Graphical User Interface) most of these files 
comprise image Information, The user need not know esoteric program 
languages. With web browsers the user can simply point and click with a mouse. 

For TV within certain standards such as NTSC, (National Television 
20 Standards Committee) the broadcasting industry assures that all NTSC standard 
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TV sets will render the programming faithfully with respect to the video and audio. 
The TV set may be old and even black and white Vs color and with only one poor 
quality speaker. The size of the TV also does not matter. The viewer will see and 
hear a program that is faithful to the broadcast content. 

5 

Where as with computers and their use for browsing on the Internet, no 
such widely adopted standard exists. In particular computers that are connected 
to the Internet such as Intel / Microsoft based PCs, Mac, Web TV, internet 
appliances, PDAs (Personal Digital Assistant), and even cell phones all have 

10 widely different processing and imaging capabilities. Additionally, they are 
connected to the Internet, with very different speeds and qualities of connection. 
The Internet author must take into account both the visual quality and the time to 
send and render these images. That which will fill a small PDA screen in black 
and white will be very small when viewed on a large CRT connected to an 

15 engineering workstation. From the other point of view, a full-page image with 
millions of colors will not even display on a small PDA. Accordingly, the need 
exists for an image translation method that is aware of the device that requested 
the image and also of the interconnection speed. 

20 
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Of particular importance is an entire new set of connected devices such as 
cell pliones and PDAs. These devices have small displays with poor image 
processing capabilities. However the user is typically a mobile professional that 
expects high quality content that is timely and very legible, perhaps even in full 
5 sunlight. Accordingly the need exists for images to be convertible so as to 
communicate the sought for information within the confines of the connection 
speed, quality, processing and imaging capabilities of the requesting client. All this 
translation and selection should be accomplished in a timely fashion and with a 
reasonable cost at the server. 

10 

Typically, a user of the WWW (World Wide Web) wishing to share visual 
information must create an image in one format for distribution. Variations in 
network speed, browser functionality, and computer processor capabilities make 
limiting visual presentation over the WWW to one format undesirable. 

15 

Therefore a need exists to overcome the problems with the prior art as 
discussed above, and particularly for a certain class of images that contain not 
only visual information but also textual information. 

20 
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Illustrated In FIG. 1, Is a block diagram 100, representing a diverse 
population of networked devices, such as found on the Internet. There is a web 
content server 104, which is connected to the network 102 with a high-speed 
connection known as a T-1 connection 106. This server is hosting information 
5 content, which contains at lease some graphical files 1 08. 

There is a business grade workstation 110 connected to the network 
through a DSL connection 112. This station also has high-end graphic capabilities 
114. 

10 

A high-speed satellite dish 118 is wirelessly connecting a Macintosh class 
Apple computer 1 16 to the network. This computer has a graphic capability that is 
non-Intel based. 

15 The notebook PC 120 is connected to the network through a normal dial-up 

connection known as POTS 122 (Plain Old Telephone System). The notebook's 
graphic capability is usually not as good as a normal desktop. 

There is a cell tower connected to the network 124 (computer is not shown) 
20 that is wirelessly connected to a PDA 126. The connectivity and graphic capability 
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for this device is very low, and yet the need for receiving timely information is 
usually very high. 

Lastly, there is a satellite up-link server 128 that is connected to the network 
through a T-1 connection! 30. This up-link sen/er provides information to satellite 
subscribers by transmitting information to a satellite for re-broadcast back to earth. 
It has a high-end graphic platform 132. 

It is noted that the speed and quality of the connections to the network 
varies greatly for the different devices. Additionally, the computer processing and 
graphic capability for these different machines have very different abilities. The 
rendering and viewing experiences for the different platforms are very different. 
Accordingly there is a need to serve the intended images across the Internet into 
these different platfonns in an efficient and timely way. 

3. Summary of the Invention 

According to a preferred embodiment of the present invention, a content 
distribution system receives a request for delivery of information to a networked 
device, the information comprising image information. The system determines, 
based on at least one of an image delivery parameter and an image presentation 
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parameter associated with the networked device, an image format for the image 
information for delivery of the image information to the networked device and for 
presentation of the image information at the networked device. The system then 
provides a response for the request, the response comprising at least a portion of 
5 the image information in the image format. 

According to a preferred embodiment of the present invention, a content 
server system comprises a first memory for storing at least one of an image 
delivery parameter and an image presentation parameter associated with a 
10 networked device, a network interface for communicating with a network, a 
controller, communicatively coupled to the first memory and to the network 
interface, and a second memory, communicatively coupled to the controller, for 
storing computer instructions for the controller to control the content server system 
to: 

15 receive a request for delivery of information to a networked device, the 

information comprising image information; 

determine, based on at least one of an image delivery parameter and an 
image presentation parameter associated with the networked device, an image 
format for the image information for delivery of the image information to the 

20 
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networked device and for presentation of the image information at the networked 
device, and 

provide a response for the request, the response comprising at least a 
portion of the image information in the image format. 

5 

4. Brief Description of the Drawings 

FIG. 1 is an ICON diagram illustrating an exemplary client server network 
content distribution topology in accordance with existing technology. 

10 FIG. 2 is a block diagram illustrating an exemplary networked content 

distribution server system in accordance with a preferred embodiment of the 
present invention. 
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FIG. 3 is a block diagram illustrating an exemplary networked content 
distribution server system in accordance with an alternative preferred embodiment 
of the present invention. 

FIGs. 4, 5, and 6, are flow diagrams illustrating an exemplary operational 
flow sequence for an exemplary networked content distribution server system such 
as shown in FIG. 3, in accordance with a preferred embodiment of the present 
invention. 

FIG. 7 is a flow diagram illustrating an exemplary operational sequence for 
a system such as shown in FIG. 2, according to a preferred embodiment of the 
present invention. 

FIG. 8 is a flow diagram illustrating an exemplary operational sequence for 
creating image information for an exemplary server system such as shown in FIGs. 
2 and 3, according to preferred embodiments of the present invention. 

Figure 9 is a diagram illustrating several tables of information containing 
examples of the client's processing and imaging capabilities and the 
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interconnection speed, with which an optimum image for a given request is built 
and served. 

5. Description Of The Preferred Embodiments 

5 The present invention, according to a preferred embodiment, overcomes 

problems with the prior art by simultaneously creating from an original image a set 
of available binary and text base vector graphic files for delivery to and 
presentation by particular networked devices. The invention efficiently selects the 
best image format for distribution of image information to the networked devices. 

10 

This invention is related to the deployment of visual information over a 
network such as the Internet or World Wide Web (WWW). However, other 
networks, such as a local area network or other types of wide area networks would 
likewise benefit from the advantages of the present invention. 

15 

The WWW is comprised of an expansive network of interconnected 
computers through which governments, business, organizations, and individual 
make information and resources available through shared files. Users connected 
to this network navigate and obtain this information by the use of a web browser. 
20 Information is gathered by the web browser and rendered for presentation to the 
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user. Typically, the views produced consist of text and images laid out according 
to the Hypertext Markup Language (HTML) for personal computers and wireless 
protocols, such as Wireless Access Protocol (WAP), for mobile devices. 

5 Images make up a large portion of the information presented to users 

through the WWW, and recent browsers provide several methods for defining this 
visual content. These methods can be broken down into two categories, binary 
encoding, and vector-based textual description. Binary images are broken down 
pixel by pixel and are translated into binary representation stored in a single file. 

10 Vector-based images take a different approach, describing an image by its 
characteristics rather than encoding it directly. Examples of binary encoded image 
formats include JPEG, GIF, and PNG. Examples of vector-based graphics include 
the Vector Markup Language (VML), Scalable Vector Graphics (SVG), and HTML 
Image Maps. 

15 

A preferred embodiment of the present invention proposes a system, 
method, and computer readable medium for creation of binary and vector-based 
images for distribution on a network. It also describes a method for determining 
the optimal image format for distribution over a network to a particular user, or 

20 
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client. The invention selects the optinnal format in terms of speed of delivery and 
presentation, with minimal perceptible differences to the end user. 

Users of the WWW desiring to attract people to their sites are constantly 
5 seeking ways to improve presentation and speed of access. A preferred 
embodiment of the present invention allows distributors of content on the web to 
combine the advantages of binary and vector-based images. It also ensures that 
images are distributed with optimum efficiency across the network. It additionally 
speeds the delivery of images while maintaining visual quality for the image 
1 0 information being presented at a networked device. 

A preferred embodiment of the present invention combines two solutions, 
one solution comprises a programming tool for creating applications and 
corresponding image information, and the other solution comprises a 
1 5 determination algorithm, to solve the problems presented above. 

An advantageous method is used to determine the type of graphical output 
format most appropriate for a particular session between a sen/er of web content 
and a client networked device receiving that content. Although the present 
20 discussion illustrates using an exemplary client/server system arrangement, it 
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should be obvious to those of ordinary skill in the art, in view of the present 
discussion, that other system arrangements will likewise utilize the advantages of 
the present invention. For example, any networked devices that communicate with 
an image information serving system would likewise benefit. Additionally, a peer- 
5 to-peer network topology would likewise benefit from the preferred embodiments of 
the present invention. Therefore, the use of the terms server and client in the 
present discussion shall be understood to cover all other such similar 
arrangements of image serving networked devices and image receiving networked 
devices. 

10 

The advantageous method analyzes factors including network speed, 
capabilities of the web browser (or user-agent), and any known properties of the 
capabilities of the system hosting the client's browser. The new method first 
determines which graphical formats the client is able to render. From those 
15 possibilities, it selects the format(s) that will provide the user with the optimal 
format determined from network transfer and rendering time and final display 
functionality. These formats are preferably communicated to an Application 
Programming Interface (API) for use in creating the images. 

20 
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An API is a set of programming tools made available in a package to 
expand the available functionality of a programming environment. In the preferred 
embodiment of the present Invention, an API is defined which offers methods for 
defining a two dimensional graphical object. The methods offered to the 

5 programmer by the API are independent of the graphical output format to be 
produced. The methods also allow the specification of Information that is not 
entirely graphical in nature, such as textual descriptions or hyper-links associated 
with a geometric region. When a method from the API is invoked, according to a 
preferred embodiment of the present invention, images are stored in memory 

10 buffers In binary or vector-based format and further the image format can be 
modified as selected by that method. Thus, a near identical image can be 
produced in multiple selectable output formats for distribution of image information. 

6. The Architecture 

15 In an exemplary system, a browsing device connected to a network such 

as the Internet makes a request to a web server for documents to display. This 
request, according to a preferred embodiment, also contains information about the 
browsing device making the request. The request from the browsing device is 
augmented with information known to the server but not part of the original 

20 request, such as user identification and session parameters. A preferred 
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implementation of tine invention stores information about network speed and client 
processing capabilities for each session between client and server. Tiie final 
request sent to the web sen/er, contains information identifying a document that a 
client networked device is requesting, as well as information about network status 
5 and client networked device capabilities for the active session. 

Within the web server, the role of the response generator is to receive the 
request and send the appropriate requested content back to the client-networked 
device. The generator is an extension of the web server and can take the form of 

10 a Java Servlet, a CGI program, etc. The response generator separates the 
session parameters from the other data in the request and sends that session data 
to the determination proxy. The generator then takes the actions necessary to 
produce the content of the response. In the process of generating the response, it 
may become necessary to generate graphical content. In such a case, the 

15 generator sends a series of method calls that first define the visual content of the 
image and then makes a call to flush that output to the response. The generator 
then continues generating the rest of the response. 

The determination proxy analyzes the session information passed to it from 
20 the response generator and informs the image server which formats are 
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appropriate for the given request. The proxy does this by analyzing network 
connection speed, rendering capabilities of the client browser, processing 
capabilities and speeds of the client's network device, and other such factors given 
it from the response generator. In general, higher connection speeds with high 

5 processing capabilities will allow the highest quality image formats available, while 
lower connection speeds and processing capabilities will restrict the response to 
either solely vector-based images, or binary images of lower quality. The response 
generator also has the ability to influence the decision of the ultimate image output 
format by adding information to the session information that will influence its 

1 0 selection. The final determined output formats are passed via the graphic API. 

The graphic API contains the programming tools and data structures 
necessary to create and output the various vector and binary based images. 
Methods within the API are called in order to define the visual and structural 
15 content of the images. The methods include calls such as draw_square, draw_ 
image, etc. The methods also incorporate techniques for embedding meta-data 
about geometric sections of the image such as text-based descriptions or data 
links. Each method exists independent of the graphical output format so that the 
method may be applied to each format specified by the Determination Proxy. 
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Upon initial instantiation, the API creates image data buffers for each of the 
fonnats specified by the determination proxy. As method calls are made to the 
API, each image buffer is altered appropriately to reflect the call. For example the 
draw_square method would change the pixel values in a binary image such as in a 
5 JPEG or PNG buffer and it would add the coordinate description of a square to the 
buffer of a vector-based image such as in VML. When the response generator 
has completed the image content method calls, it makes a final call to flush the 
appropriate image buffers into the response. 

1 0 The response is comprised of all data streams that are sent from the server 

to the client who made the original request. The response will include text and/or 
binary files representing both the image and non-Image data generated from the 
response generator and graphic API. 

15 By maintaining this programming API graphic generation, according to a 

preferred embodiment of the present invention, a content server allows for 
graphics to be converted and sent on the fly in response to parameters specified in 
the client's request. For example, a stock chart reflecting the most current stock 
prices, could be generated by the response generator. When appropriate for the 

20 
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session, a chart can be returned in binary form, vector form or a mix of both 
without additional manipulation of the response code. 

While there are graphical conversion and creation application programs 
5 available that can save two dimensional graphic images in a variety of formats, 
there are no known programming tools available that allow simultaneous creation 
of both binary and vector-based images. There are also no known methods in use 
for determining optimal session-based graphical formats for distribution across a 
network, such as the Internet, which preferably take into account both binary and 
1 0 vector-based image formats. 

On the other hand, a preferred embodiment of the present invention allows 
for delivery of image content over the Internet in a manner that is efficient and 
flexible. A high level summary of the sequence of steps taken by a preferred 
system to generate an image serving response to a client's request is as follows: 

15 

A request is received by the server, augmented with session data, and passed to 

the response generator. 
The response generator sends session information to the determination proxy. 
The determination proxy communicates to the graphic API which graphic formats 
20 are appropriate for generation. 
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The response generator generates the response. When an image needs to be 
created as part of the response, the response generator calls methods in the 
graphic API that define and output graphics and image information. 

The server returns the response to the client. 

5 

7. Details Of The Preferred Embodiments 
Adaptive Formatting and Image Serving 

FIG. 2 illustrates an exemplary adaptive formatting and image serving 
system 200. Connected to a network 202, such as the Intemet, is a first 
10 networked device 204 and display 1 205, and a second networked device 206, 
display 2 207 and a presentation interface 2 209. The presentation interface 209 
represents such solutions as a printer, FAX, overhead project or similar. Also 
connected is an Image format determination server 248 and a web content server 
208. Together these act in accordance with the subject invention. 

15 

The Web Content Server includes a network interface 210. The OS 
(Operating System) 212 controls the entire server 208. The Image Server 214 is 
running under the OS and works with the Image DB (Data Base) 216. The 
Database 216 contains two exemplary listings, which are taken to be two of many. 

Docket No. ARC920010008US1 19 



EXPRESS MAIL LABEL NO. EL746147284US 

The first entry, Header 1 218 represents the link list of all available image formats 
for Image A. They are Image A Format 1 220, image A Format 2 222, Image A 
Format 3 224 and finally the end of field record, Null 226. The second entry, 
Header 2 228 represents the link list of all available image formats for Image B. 
5 They are Image B Format 1 230, Image B Format 2 232 and finally the end of field 
record. Null 234. 

The selected fomnat of the requested image is built in the Image buffer 236 
by the image server 214. The image proxy application 238 and image proxy API 

1 0 engine 240 accomplishes a request for image information and obtaining the image 
information in the selected fomnat in the image buffer 236. The response to a 
request from a networked client 204 is created in the response buffer 242. The 
server also has a drive 244 for non-volatile storage. The entire Web Content 
Server behavior can be contained on computer readable medium 246. 

15 Additionally, computer readable media 246 such as CD-ROM, Floppy, and other 
removable media can be used with a compatible drive 244 in the server 208. In 
this way, the functions and operations of the server 208 and the image information 
for the database can be updated. 

20 
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The Image Format Detemiination Server 248 includes a list of known image 
delivery parameters stored in a capability database 258. The server 248 contains 
an OS 250, which in turn controls the network interface 252, a non-volatile storage 
drive 254 and the Image Proxy Engine 256. The image Proxy Engine 256 

5 operates with the capability database 258 to determine image format for a 
requested image information. Illustrated are two data base records, which 
represent many. ID1 260, lists image delivery parameters 262 and image 
presentation parameters 264 for a particular networked device. This represents a 
specific network and network connection speed, and the Image rendering 

10 capabilities of the particular client device. In a similar way 1D2 266 lists specific 
image delivery parameters 268 and image presentation parameters 270 for 
another networked device client. The entire Image Format Determination Server 
behavior is contained on computer readable medium 272, such as CD-ROM, 
Floppy, and other removable media. The removable media can be used with a 

1 5 compatible drive 254 in the server 248, In this way, the functions and operations 
of the server 248 and the image information for the database can be updated. 

When a networked device such as 204 sends a request for an image from 
the network 202 the image format determination server 248 receives the request. 
20 Additional information besides the requested image is passed along with the 
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request. This information includes: networl<ed device type, display capability, its 
connection type and quality. This information is used to access the device 
capability database 258. This database is used to assemble a list of possible 
image format types. Image formats that are not possible are not listed. This 

5 information is passed to the web content server 208. The list of possible image 
fonnat types is sorted using a weighted set of parameters. These parameters 
include compatibility with the networked device, quality and time to render. This 
information is assembled in the Image database 216 and may be stored for future 
reuse, or assembled on the fly for each usage. The image proxy app 240 selects 

1 0 the best-fit image format from the image DB 21 6. The image proxy API 240 builds 
this image in the image buffer 236. This image is then served to the requesting 
network device 204 by the image server 214. This completes the image selection 
and serving process. 

Alternative Version of an Adaptive Formatting and Image Serving 
1 5 System 

FIG. 3 shows an alternative embodiment of an exemplary adaptive 
formatting and image serving system 300. Illustrated is a network such as the 
Internet 306. Connected to the network is a first networked device 302 with a 
display 303 of a particular presentation capability. A second networked device 304 
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is also connected to the network 306, which has a display 305 and a presentation 
interface 307. The presentation interface 307 represents such solutions as a 
printer, FAX, overhead project or similar output devices. Also connected to the 
network 306 is a web content server 308. This illustrates an alternative 

5 embodiment of the present invention. An OS 310 controls this server 308. The 
server's connection to the network 306 is performed via the network interface 312. 
The Image Proxy Application 316 and the Image Proxy API 318 respond to 
requests for image information from networked devices. This is accomplished by 
building an image in the image buffer 320. The image server 322 and the image 

10 proxy engine 324 accomplish this build. The response is created by the image 
proxy app 316 in the response buffer 314. The response Is then delivered via the 
network interface 312 into the network 306 for distribution at the requesting 
networked devices. 

The image proxy engine 324 accesses the networked device capability DB 
15 326. The ID1 328, lists image delivery parameters 330 and image presentation 
parameters 332, and other related parameters 334. This record represents a 
specific network and network connection speed, and the Image rendering 
capabilities of a particular networked device client, such as for first networked 
device 302. In a similar way 1D2 336 lists specific image delivery parameters 338 
20 and image presentation parameters 340, and other related parameters 342 for 
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another client such as fro the second networked device. These entries represent 
two of many. 

The image server 322 accesses the image DB 344. The database contains 
two exemplary listings, which are taken to be two of many. The first entry, Header 
5 1 346 represents the link list of all available image formats for Image A. They are 
Image A Format 1 348, and the end of field record. Null 350. The second entry. 
Header 2 352 represents the link list of all available image formats for Image B. 
They are Image B Fomnat 1 354, Image B Format 2 356 and finally the end of field 
record. Null 358. 

1 0 Flow Diagrams of the Device Database update of tiie Image Proxy 

FIGs. 4, 5 and 6 illustrate an operational flow sequences from the server 
system 300. A client's communication to a content image server 208 is 
represented by the enter point 402. The client's capabilities are reviewed for 
updating the database if required 404. If the device is new to the system 300 or its 
15 capabilities have changed, the database 326 is updated 406. If no updates are 
required or after the update is completed, the server 208 checks whether a client is 
requesting an image proxy 408. If there is no request, or the image proxy is 
performed 410 the flow exits 412. 
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FIG. 5 shows a flow diagram 406 updating a record in the capability 
database 326. The flow starts at the enter point 502. A check is performed to see 
if the update requires that a new record is to be placed in database at step 504. If 
so, a new device record is created and placed in the database, 326 at step 506. If 
5 no new record is needed, then the server 308 points to the appropriate records in 
the database 326, at step 508 image delivery parameters for the device record. 
Then, the server 308 updates at step 512 image presentation parameters for the 
device record are placed in the database 512. The flow then exits at step 514. 

1 0 FIG. 6 shows a flow diagram 410 selecting an appropriate image format for 

the image server 322. The request for an image enters the flow diagram at step 
602. The available image formats may be found in the image header for a 
particular image fonnat 604. The image server 322 sends a lookup request to the 
image proxy engine 320. The request includes the available image formats for a 

15 requested image and networked device identification information. The image 
proxy engine 324 performs a lookup, at step 606. The image proxy engine 320 
receives the optimum available image format for the networked device 608. 
Finally, the selected image format is presented to the image server 322 and the 
flow is exited 612. 

20 
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Image Serving by the Present Invention 

FIG. 7 shows a flow diagram 700. The flow is entered, at step 702, when 
the image server 214 receives a request to serve particular image information, at 
step 704, that is destined for reception and presentation by a particular networked 

5 device. The image server 214, at step 706, sends a query to the Image Format 
Determination Server 248 to detemnine an optimum image format for the particular 
image information to be delivered to, and presented by, the particular networked 
device. The image server 214 sends to the image Format Determination Server 
248, at step 706, the query that identifies the particular networked device and also 

1 0 the header infomnation associated with the particular image information from the 
image DB 216. The image Proxy Engine 256 receives the query and follows the 
novel image format detemnination method, as has already been discussed above, 
in order to determine an optimum available format for the image information. The 
image Proxy Engine 256 applies the weighting factors to the capability parameters 

15 and to the corresponding available image formats for the particular image 
information. The image Proxy Engine 256 accordingly determines the optimum 
image format for the particular image information to be delivered to, and presented 
by, the particular networked device. The image Proxy Engine 256 then sends a 
response to the image server 214 to provide the detemnined optimum image 

20 fonnat for the image information to the image server 214. The image server 214, 
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at steps 708 and 710, receives the selected optimum image format and tiien 
serves up tine particular image information in the optimum image format into the 
image buffer 236. Control is then handed back to the Image Proxy API 240 and 
the Image Proxy Application 238, and the flow diagram is exited, at step 712. 

5 The Image Format Detemninatlon Server 248 has been described servicing 

one Web Content Server 208. Alternatively the Image Format Determination 
Server 248 can serve a plurality of Web Content Servers across a network, such 
as the Intemet. Additionally, the locations and types of Web Content Servers that 
may operate with the single Image Format Determination Server 248 may be 

1 0 diverse. In this way, for example, the Image Format Determination Server 248 can 
be shared across many different content servers across the internet. This 
provides significant cost savings for a system operator thereby enhancing the 
commercial viability of a content distribution system implementation. 

15 In a distributed network approach, such as illustrated In FIG. 2, the Image 

Format Determination Server 248 would regularly receive updates to the capability 
database 258 via the network 202. According to one preferred embodiment, web 
content servers 208 would receive communications with networked devices 204, 
206, and collect capability infomnation corresponding to the networked devices 

20 204, 206. For example, as the first networked device 204 accesses the network 
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202 from varying communication links, the changes in communication capability 
can be monitored by the web content server's 208 and updated to the capability 
database 258 in the Image Format Determination Server 248. The image server 
214, for example, would send an update message to the image proxy engine 256. 

5 The image proxy engine 256 would then accordingly update the capability 
database 258. Similarly, if a new presentation resource (e.g. a new display 
system) is being used in the first networked device 204, for example, then the 
image server 214 would send an update to the image proxy engine 256 to update 
accordingly the capability record corresponding to the first networked device 204, 

10 as stored in the capability database 258. 

Creation of Image Records According to the Present Invention 

FIG. 8 shows a flow diagram 800 illustrating an exemplary operational 
sequence for creation of image proxy applications 238 (such as shown in FIG. 2) 
and corresponding image records 218, 228, for the Image DB 216 and the web 
15 content server 208. Note that although the discussion below will refer to FIG. 2, 
the exemplary operational sequence similarly applies to the creation of image 
proxy applications 316, as shown in FIG. 3, and the corresponding image records 
346, 352, for the image database 344 in the web content server 308. This 
exemplary operational sequence can be followed, for example, by a computer 
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system (not shown) used as a development workstation. The development system 
can be standalone or can be networked and can even be in network 
communication coupling with the web content server 208 to deliver image proxy 
applications 238 and con-esponding image records 218, 228, to the web content 
5 server 208. A software developer, for example, would use software development 
tools to create the image proxy application 238 and to embed therein the Image 
Proxy API 240, such as including code and data for use by the image proxy 
application 238 to communicate with the image server 214 as described above 
with respect to the prefen^ed embodiments. 

10 The flow is entered, at step 802, when, according to one preferred 

embodiment, a development system receives, at step 804, at least one image 
fomiat corresponding to an image for storing in an image record 218, 228, in the 
Image Database 216. Typically, the developer of the image proxy application 238 
will have control over the selection of image infomnation for use with the image 

1 5 proxy application 238, and the developer will additionally have control over the 
typical available image formats for the particular image information for the image 
proxy application 238. 

Then, at step 806, a development system preferably determines all 
20 available image formats for the image information. This set of all available image 
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formats may be greater than, or less than, the set of typical image formats that the 
author and/or developer of the image proxy application 238 selected at step 804. 
This set of all available image formats is indicated in the header information in the 
image record 218, 228, and each image format constitutes an entry in the linked 
list of image formats associated in the image record 218, 228. This process 
results in, at step 808, the creation of a header with weighted parameters for the 
image format selection. Finally, at step 810, the image record for the Image DB, 
the record including the header and the available image formats for the particular 
image is created. This image record is then ready to be stored in the Image 
Database 216. The flow is exited at step 812. 

Note that the image record may store a linked list of available image 
formats, where the items in the linked list are descriptions of the image formats for 
the image server 214, in the content server 208, to create a final image information 
in a determined optimum image format when requested by the image proxy 
application 238 via the image proxy API 240. Alternatively, the available image 
formats stored in the linked list may comprise actual image information in the 
particular image fonnat for an item of the linked list. In this way, in response to a 
request for image information via the image proxy API 240, the image server 214 
serves up the determined image information in the optimum image format directly 
from the image record in the database with reduced processing requirements. It 
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should be obvious to one of ordinary sl<ill in tine art from the discussion above that 
an embodiment of the present invention can trade-off storage memory 
requirements for operational processing requirements and response time. A web 
content server 208 implementation, advantageously, can balance between storage 
requirements for an image database 216 and the processing requirements of the 
image server 214 by serving the image infonnation in a determined optimum 
image format. This is accomplished by storing pre-assembled image information 
in the particular image formats in the image record DB 216. This will increase the 
storage memory requirements, but assure fast image server response time with 
little operational processing required. This trade-off can be implemented, 
according to one preferred embodiment, into the database record 218, 228, for 
particular image information when created by the developer of an image proxy 
application 238. 

The created image records 218, 228, and the created image proxy 
application 238, can then be written to a non-volatile computer readable storage 
medium 246 such as a CD-ROM. This non-volatile computer readable storage 
medium 246 can then be used to distribute the image proxy application 238 and 
corresponding image records 218, 228, to Web Content Servers 208. The non- 
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volatile computer readable storage medium 246 would be readable using, for 
example, the drive 244 of the Web Content Servers 208. 

Examples of Tables Used for Image Translation 

FIG. 9 contains a view of exemplary tables with which the image proxy 
engine 256 responds to requests for images. Table 902 contains all known client 
types and their variations and their compatibility with certain image file formats. 
This table 902 would preferably be stored, in the preferred embodiment shown in 
FIG. 2, in memory in the Image Format Determination Server 248. Examples of 
table entries would include the ability to work with text-based vectors and the 
display format size. Table 904 contains the known image types and their APIs for 
converting from one image format to another. These APIs would preferably be 
stored in the Web Content Server 208. Examples would be the conversion from a 
high quality JPEG to a text based vector image. It is noted that not all conversions 
are possible, or legible if converted. Table 906 contains a list of weighting factors 
for different network connections. These factors would be stored in memory in the 
Image Format Determination Server 248. These parameters represent the 
communication bandwidth that a networked client device is currently 
communicating with, and they determine the amount of time that an image would 
take to be communicated to the networked client device. Table 908 contains a list 
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of both wired and wireless network types and their associated typical bandwidths. 
These factors would also be stored in mennory in the Image Format Determination 
Server 248. The network type is influenced by the quality of the network 906. This 
qualification of a network type by the network quality parameter adjusts weighting 
factors associated with the network type to better characterize the likely 
communication throughput for delivering image information to the particular 
networked client device. In an example, a client may have a 56kb modem 
capability but actually be connected with a bandwidth of only 28Kb. 

Taken together at the decision node 910, the tables 902, 904, 906 and 908, 
as discussed above, are used to build a table 914, which lists all available file 
formats for a requested image. This table of listed fomiats is assembled in the 
Web Content Server 208 within the Image DB 216. Once this table 914 is 
completed, the table 912 that contains the weighting factors is used to select 916 
from the table 914 the one optimum image format for delivery to, and presentation 
by, the particular networked client device. This table of Weighting Factors 912, 
preferably resides in the Web Content Server 208. This selected image format 
918 is then used to assemble the image in the Image Buffer 236 for the image 
proxy application 238 to use in creating information in a response buffer 242 to be 
sent back to the requesting networked client device by the Web Content Server 
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208. The image proxy application 238, for example, would send the response 
information to the network interface 210 for delivery into the network 202 destined 
for reception by the particular requesting networked client device. 

5 8. Discussion of Image Serving Realization 

The present invention can be realized in hardware, software, or a 
combination of hardware and software. A content server, as illustrated in FIGs. 2 
& 3, according to the preferred embodiments of the present invention, can be 
realized in a centralized fashion in one computer system, or in a distributed fashion 

10 where different elements are spread across several interconnected computer 
systems. Any kind of computer system - or other apparatus adapted for carrying 
out the methods described herein - is suited. A typical combination of hardware 
and software could be a general-purpose computer system with a computer 
program that, when being loaded and executed, controls the computer system 

1 5 such that it carries out the methods described herein. 

The present invention can also be embedded in a computer program 
product, which comprises all the features enabling the implementation of the 
methods described herein, and which - when loaded in a computer system - is 
20 able to carry out these methods. Computer program means or computer program 
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in the present context means any expression, in any language, code or notation, of 
a set of instructions intended to cause a system having an information processing 
capability to perform a particular function either directly or after either or both of the 
following: a) conversion to another language, code or, notation; and b) 
reproduction in a different material form. 

Each computer system may include, inter alia, one or more computers and 
at least one computer readable medium allowing a computer to read data, 
instructions, messages or message packets, and other computer readable 
information from the computer readable medium. The computer readable medium 
may include non-volatile memory, such as ROIVI, Flash memory, Disk drive 
memory, CD-ROM, and other permanent storage. Additionally, a computer 
medium may include, for example, volatile storage such as RAM, buffers, cache 
memory, and network circuits. Furthermore, the computer readable medium may 
comprise computer readable information in a transitory state medium such as a 
network link and/or a network interface, including a wired network or a wireless 
network, that allow a computer to read such computer readable information. 

Although specific embodiments of the invention have been disclosed, those 
having ordinary skill in the art will understand that changes can be made to the 
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specific embodiments without departing from the spirit and scope of the invention. 
The scope of the invention is not to be restricted, therefore, to the specific 
embodiments, and it is intended that the appended claims cover any and all such 
applications, modifications, and embodiments within the scope of the present 
invention. 

What is claimed is: 
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